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Summary 


n/ 

Tf.«  prcLlem  .f  determining  tr.e  minimum  of  W%e- functional 
T  T 

J(y)*/'  a  i  (t )  (y-t>  I  (t )  )^<lt+ a,(t )  (y  .  . 

u  O 


/■  ^  ^  ( t  t  j  )^dt ,  ever  all  y(t)  eubjec?! 

I  It— ^  \ 

tne  c  nstralnts  y(0)«Ci,  y  '  (0)*Ca,  •  •  •  ,y'  ^  ^  ®  treated 


using  tfie  lunctlunnl  equation  tecnnlque  of  the  theory  of 
dynamic  programming.  The  problem  Is  reduced  tr  tne  solution 
f  a  system  of  ordinary  differential  equatl  ns  satisfying 
-ne-pulnt  b  undary  conditions. 

The  discrete  case,  corresponding  to  the  minimization  of 
^  class  of  quadratic  forma,  Is  also  treated  by  the  same  general 
method.  A  particular  problem  of  this  type  arises  In  the 
treatment  rf  tr.e  optimal  Invent  ry  problem  by  Holt,  Simon, 
and  Modigliani 
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On  a  ClasB  cf  Variational  Problems 

1 1  .  Introduction 

A  class  cf  mathematical  problems  <Kr,lch  crlse  In  c  nnectlon 
with  various  avera^-lng  cr  smoctnlng  pr  cesses  In  applied 
matnematlcs  involve  minimizing  tlie  functl  nal 

T  T 

(1)  J(y)-y  a  i(t)  (y(t)-t  1  (t )  j'dt-^  ,/*  aa(t  )  (y '  (t  )-ba(t)  )^dt 

c  0 

T 

•*■...,/  aj^(t)  (y  ^  (l)-bj^(t)  )^dt 

L 

over  all  y(t)  subject  tc  constraints  of  tr.e  f  x*m 

(2)  y  (0)-x  i  ,y  ’  (0)-x8 . y  ^  (0)-Xj^_^ 

The  standard  apprcac:.  to  tols  problem  employing  the 
classical  variational  techniques  leads  to  a  linear  equation 
In  y(t)  of  order  2K.  with  K  conditions  at  t-0,  given  above  In 
(2),  and  K  additional  constraints  at  t-T  lerlved  from  tice 
varlat 1  n . 

For  the  case  where  K-1.  the  ccmput  o  t:  K  na  1  ;r  tlem 
posed  by  this  equation  Is  fairly  simple  t  res.  Ive.  For 
K>2 ,  aowever,  the  c- mp^tat  1  o,n-n  1  pr’-^Llem  tec  mei  Jlfilcull, 
since  we  are  faced  wit:  the  ^rctlerr.  I'  s  Ivlfig  systems  f 
equatl  ns  cf  verier  K,  wit:.  e<io:  trial  s  Autlo^n  Inv  Ivlng 
tne  ndmerl:al  S'  lutl^n  !  linear  equatl  n  f  v,rder  2K. 

T.-  typciss  tals  tw  -p  Int  tounlary  value  pr  tlem  md  re  lu 'e 
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the  problem  to  a  one— point  boundary  value  problem,  we  shall 
employ  the  functlonol  equation  approach  f  the  theory  of 
dynamic  prcgrammln*^ ,  L  ■  J*  Although  In  general  this  leads 
t.;  partial  differential  equations,  In  this  case  the  quadratic 
Character  ^.f  toe  functional  J(y)  permits  us  to  reduce  the  problem 
tu  a  system  of  ordinary  differential  equations  of  simple 
type,  whwse  numerical  solution  Is  readily  accomplished. 

After  dl scuss 1 ng tne  ocntlnuous  case,  we  shall  treat  the 
discrete  case,  a  particular  example  of  which  arises  In  mathe- 
msolcai  econ  mlcs  In  connection  wlt.a  some  scheduling  problems, 
see  Holt,  Modigliani,  and  Simon,  [  >u  *  Arrow,  Harris,  and 
Marscnok,  [iji  and  Bellman,  Gllcksberg,  and  Gross,  J. 

A  further  discussion  of  the  functional  equation  technique 
with  application  to  eigenvalue  problems  and  other  variational 
problems  may  be  f-und  In  [3  J • 

t 2 .  The  case  K»1 

It  Is  sufficient  to  consider  the  case  K-1 ,  where  the 
analytic  details  are  simplest  In  order  t-  Illustrate  the  met/.od. 
After  a  thorough  discussion  of  this  case,  we  Bh.ail  briefly 
Indicate  the  extension  of  th^e  method  to  higher  values  of  K. 

We  begin  ty  Imbedding  the  problem  discussed  In  (l.l) 
for  K-1  within  the  more  general  problem  of  de tenni.nln^:  the 
minimum  wf 

T  T 

ai(t)  (y-bi(t))^dt-fy^  a  ,  ( t )  (y '-b*  ( t )  )  ^dt 

3  8 


(1) 
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all  y  subject  to  the  constraint 
(2)  y(8)-c, 

and  0<s<T.  We  assume  that  all  the  functions  that  appear  are 
continuous,  and  that  a^(t)>0  for  O^t^,  so  that  we  can 
restrict  ourselves  to  the  class  of  functions  for  which  y';^L  (0,T), 
Define  the  function 

(5)  f (c,8)-  Min  J(y,B) . 

y 

Let  us  now  obtain  a  functional  equation  for  f(c,8)  which  in 
the  limit  will  reduce  to  a  partial  differential  equation. 

Write 

s-fh  T 

(4)  f(c,8)-y"  ,  0<h<T-e. 

8  84-h 

for  an  extremal  y(t).  Choosing  y'  In  the  Interval  Ls.s-fh 
we  see  that  we  have  a  problem  similar  to  the  original  with  s 
replaced  by  s^h,  and  c  replaced  by  the  value  of  y(t)  at  t-s-t-h. 
Employing  what  we  have  called  the  "principle  of  optimality", 
cf  ] ,  equation  (4)  gives  rise  to  the  equation 

8-*-h  P 

(5)  f(c,8)-Mln  ,  L  .7^  t  a , (t ) (y-b j (t ) )  ^aj ( t ) (y '-ba ( t ) 

h  [b  ,  8  -t-h  j  8 

-♦-f  (y  (B-*-h)  ,8-»“h)  ♦  . 

Let  us  now  assume  that  the  extremal  curve  is  continuous 


in  t  and  has  a  continuous  derivative,  and  furtrier  that  f 
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poBe«88e8  continuous  partial  darlvativss  with  r«8p«ct  to  c  and 
8.  The8e  results  may  be  established  by  appealing  to  tne  classical 
theory  of  the  calculus  of  variations,  or,  as  we  shall  see  at 
the  end  of  the  paper  by  a  passage  to  the  limit  from  the  dis¬ 
crete  case. 

Assuming  the  above  continuity  properties,  let  us  pass 
to  the  limit  as  h— >0.  Minimization  over  an  interval  [c,s-»h]  reduces 
to  minimization  over  values  of  y'Cs).  Let  us  call  the  unknown 
value  of  y'(e),  v,  where  v  is  a  function  of  c  and  s  to  be 
determined.  Using  the  fact  that  y (s-fh )»y (e )-»-h  y'(s)-*'0(h)- 
c-*-hvK(e)  and  passing  to  tne  limit  in  (5)  ss  h-40,  we  obtain 
for  f(c,8)  the  non— linear  partial  differential  equation 

(6)  0-Mln  [  a  1  (s)  (c-b  i(8)  )^-*'aa(s  )  (v-bt(8)  ‘ 

The  minimum  is  assumed  at 

(7)  2aa(e)(v-b,(e))^-f^-0, 

which  determlnee  v  once  f  has  been  found,  and  the  resulting 

equation  for  f  is 

0 

? 

(o)  f  »  -ai(8)(c-bi(8;)  >t,f - ^ -  . 

®  "  4a, (s) 

T^le  initial  value  for  f  Is 

(9)  f (c ,T)-0  for  all  c  . 


Let  U8  now  assume  that  f(c,8)  has  the  form 


P-711) 

_r; _ 


(10)  f  (c  ,8  )-u (s  )-fcv  (s  ) (e) . 

Equating  cc«fflclent8  In  (6)  we  obtain  the  equatlone 

2  v^Cb) 

(11)  (a)  u' (8)*-ai(8)bl(8)+btv(8) - 

4a. (b) 

v(8)w(b) 

(b)  v' (B)-2a 1 (a)b I  (8j+2baw(8 ) - 

a.(8) 

w-(t) 

(c)  w' (b)-  -a i(8) - 

a.(8) 

with  the  Initial  conditions 

(12)  u(T)-v(T)-w(T)-0. 

Since  there  le  a  unique  eolutlon  tc  (6)  In  the  proper 
function  clasB,  thlB  system  detemlneB  It. 

Equation  (lie)  le  a  Rlccatl  equation*,  reducible  to  a 
Becond  order  linear  differential  equation,  with  the  other 
functions  found  readily  once  w(b)  hae  been  determined.  The 
numerical  Bclutlon  of  thle  eyetem  1b  quite  easily  obtained. 

Once  f(c,8)-u(8)-»-cv(B)>c  w(s)  has  been  determined,  we 
readily  determine  v  from  equation  (7).  Then  y  le  determined 
by  the  equation 

(13)  ^  -  v(y,t) ,  y(8]-c, 
dt 

an  equation  which  we  can  solve  explicitly  since 

V (b )>2cw  (b  ) 

(14)  v(c,b)--  -  ■►ba(8) 

2aa(8) 

•Note  that  tols  Rlccatl  equatl.  n  Is  equivalent  tc  toe  second  orcer 
linear  differential  eq-:atl  n  oitc'lned  fr  m  the  Luler  equation. 
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Implies 


-v(t}>2yw(t ) 

(13)  v(y,t)-  -  >ba(t). 

2aa (t ) 

Once  the  functlone  v(t)  and  w(t)  have  been  determined,  equation 
(13)  may  be  solved  explicitly  for  y  as  a  function  of  c  a:.d  t. 


63 .  The  Case  K -2  . 

Let  US  now  examine  the  modifications  required  to  handle 
the  analogous  problem  ef  minimizing  the  Integral 

T 

(1)  U»i(t)  ly-bi(t))^'^ea(t)(y'-ba(t))^ 

s 

(y*  '-ba(t  )^jdt 


subject  to  the  constraints 

(2)  y(8)-Ci,y'(B)-Ca. 

Setting  y ' ' (s  )=rv»v  (c  1 ,  Ca ,  s  ) ,  and 

(3)  Hln  J(y,s)-f (c i,C8,s) , 

y 

the  analogue  of  (2.8)  Is 

(4)  0-Mln  X  (s)  (c  i-b  I  (s  )  )^+aa(B)  (ca-ba(s  )  (s  )  (v-baCs)  ) 

V 

-►f  -x-Caf  ■♦'Vf  j  , 

B  Cl  Ca 

wltfithe  Initial  value,  f(ci,CaT)-0  for  all  Ci,Ca* 


Once  again  we  can  obtain  a  solution  of  toe  nonlinear 
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partlal  differential  equation  for  i  by  setting  f  eqjal  to  a 
quadratic  In  ci  and  ca, 

2  2 

(t?)  f-uiCi  •♦•2uac  jCa-fUaCa  •♦•U4CJ  ■►u^Ca+u^  , 

where  the  Uj^'s  are  functions  of  s  alone.  Upon  equating 
coefficients  In  (^ ) ,  we  obtain  a  system  of  nonlinear  ordinal^ 
differential  equations  for  the  of  the  form 
du. 

(6)  -  -  f, (u  1  ,Ua,Us,U4,u.  ,u. )  ,  u.(T)-0, 

d3  D  1 

which  determine  the  Uj^  In  the  range  s  <  T. 

§4 .  Discrete  Cases 

Let  us  now  consider  some  discrete  analogues  of  the  above 
equations.  We  start  with  the  problem  of  minimizing  the 
quadratic  form 

N  P  N  P 

(1)  ^  ^  ^k^^k“^k-l^  ' 

k  *  1  k  *  1 

where  b^  and  are  non— negative  parameters,  and  Xq-x  a  given 
cone  tant . 

As  before,  let  us  define  the  sequence  of  functions 

_  N  .  P  P  , 

(2)  ^  ‘-^k^^k'^k^  ■*’®k^^k“'^k-l  ^ 

k-R 

1  -F,  .  .  .  ,N 

wnere  x^_^  Is  set  equal  to  x.  We  obtain,  as  above,  the  recurrence 


relations 
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(6)  8p(^)"  Min  ^ ^ ^^R-f  1  ^^R * 

*R 

These  relations  permit  the  sequence  |gp(x)|  to  be  computed 
quickly  and  simply.  This  approach  Is  particularly  suited  to 
problems  In  which  the  functions  and  are  non-ana  ly  tl  c ,  as, 
for  example  Yj^(x)-[x]  or  Max  (x,0). 

As  In  the  continuous  case,  the  assumption  of  quadratic 
functions  for  and  permits  us  to  go  much  further  and  find 
a  more  explicit  recurrence  relation. 


65*  Explicit  Recurrence  Relation 
Since 

•  2  2^ 

(1)  fp(x)-  Min  i.  bj^(xp-dj^)  *»-Cp(Xp-x)  j. 


we  sec  that  ^p(x)  Is  a  quadratic  In  x, 

2 

(2)  * 

where  and  Wj^  are  readily  determined  explicitly  as 

functions  of  and  d^^,  and  •<^>0. 


Turn  now  to  the  relation  for 


(3) 


^N-1 


Substituting  the  expression  for  f^  found  above,  we  find  tr-at 
Che  minimum  over  x^  .  Is  attained  at  the  point, 
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^N-l“ 


^N/2 


and  tnc  val.. 


-  cl  la 


wnere 


L^N-I^N — 1  ^^N-l^N-1  ^  ^N-1'^*N-1'^'*'n 

V  .  ^^N-i^N-l~^.Vr 

^n-i^*n-i^“n 


This  Is  a  recurrence  relation  it. at  c.nnects  the  triple 

(Hi-  i»v.  ,,Wk.  ^)  *»lt-’i  the  trli  le  (u., ,  v..  ,  w..  /  .  Iieritlnp  t.Ms 
N— 1  N— 1  fi— 1  '  .N '  N  N 

relatl  n,  we  obtain  tr.e  sequence  (u»,Vt»"'?)- 
To  determine  Xi,  we  use  t;.e  relation 
(t  )  f,(x^)-  Mir.  ,  t  ,  (x  t-d  j )" -fe  1  (x  i-x  j"  ♦  :  a  (x  I  )  ^  , 


whl  :r.  yields 


xe  i^’d  iL  j— V  ^ 


t  \*-C  3 


similarly,  the  ^llm.i^  1  e  f  x  Is  .Jlven  ty 

K 

X  , a  ;  , b  . -V  /S 

X  .  K-1  K-^  K->  k*-^' _ 

K  L.  •♦•e  ♦w 

K  K  K 


Tr.ls  (ernlis  the  sequence  Xi,X2,---,x.  I  te  c.m;jted  recurrently 
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BLarllrift  wll:.  tne  value  Xj. 

56  .  D1 8  2  re  te  C.-ise — K-2  . 

Lei  us  n.  w  c  raider  briefly  ir.e  pr  biem  discussed  by  H^lt, 
M.  ll^lla.’il,  and  Sim.  n  In  [ ^  .  It  le  required  t  minimize  tne 
express  1  n 


(1) 


where 


(2) 


8^=-X  ,>X2-^  .  .  .4X^ 


Making  a  c.'.an^’e  ^1'  variable 


(3) 


‘’’k-1 


X  -X  =y  -i’y,  ,  *-y  ^ 

K  K-l  K  *’k-1  ti-.  , 


we  r.ave  tne  ^r  t  iem  f  nlnlmlzlnp;  t:e  qu.jdratl;"  f  rm 
N 


(-) 


>,  ‘  n(i'k-n-rn''’**k‘n*>'k-.'-'’n-;'^fK(5ri,-i  )5 

K  ^  1 


ver  all  y  i  ,  y  a  ,  •  •  •  ,  y  ,  ".’.ere  we  assume  f.at  y^  and  y_^  nave 
fixed  values  x  and  /  res;  e.  1 1  vely  .  l!'  we  define 


(i) 


*  R^^’h  1  '^R. 

y, 


N 


R  .  .  k-R 

1  -P _ _  N 


L“k(n-n-i-^k  '‘“kiyk^^k. 


n 


we  ttalr.  tr.e  recurrence  relat 


n 


(6) 
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^  p  ( i  p _ Min 


^'P-i  ^^R — 1^ 

"■^R-t  1  ^^R'^h-1  ’ 


The  detennlnall  n  .1'  tr*e  sequence  j  i  p,  .  p  r  cee  :s  ae  cef,  re, 
with  tne  exception  that  f^(y,z)  r.^w  ''.as  the 


(7) 


67.  St..cf.a3llc  Case. 


Tt.e  ea.Tie  functional  equation  tecr.nlque  eufllces  t  handle 
the  ^aae  wr.ere  the  para.-neters  a.  ,L,  ,e.  ,  1.  are  taken  t  be 

1  4  1  X  A 

r'indom  variables  wltf  a  ^-Iven  /-Int  dlstrltut!  n  lunctl  n, 
provided  that  we  apree  nlr.lmlze  tr.e  exjectel  value  f 
trie  quadrttlc  Term. 


a:  *-> 
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